Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Move stable onboarding t1 tests to PR test job #15764

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Move stable onboarding t1 tests to PR test job #15764

wants to merge 1 commit into from

Conversation

xwjiang-ms
Copy link
Contributor

Description of PR

Summary:
Fixes # (issue)

Type of change

  • Bug fix
  • Testbed and Framework(new/improvement)
  • Test case(new/improvement)

Back port request

  • 202012
  • 202205
  • 202305
  • 202311
  • 202405

Approach

What is the motivation for this PR?

Some dataplane test scripts have been added to PR test and put into optional onboarding job to test case performance, I calculated the success rate of test scripts in recent 3 days, I think I can move high success rate test scripts to t0/t1 job now

TestbedName FilePath TestCase RunDate SuccessCount FailureCount TotalTests SuccessRate
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_count 2024-11-22 00:00:00.0000000 17 0 17 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_order_capability[vlab-03-None] 2024-11-22 00:00:00.0000000 17 0 17 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_interface_flap[vlab-03-None] 2024-11-22 00:00:00.0000000 17 0 17 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_keys[vlab-03] 2024-11-22 00:00:00.0000000 17 0 17 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_content[vlab-03] 2024-11-22 00:00:00.0000000 17 0 17 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_flap[vlab-03] 2024-11-22 00:00:00.0000000 17 0 17 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_lldp_restart[vlab-03] 2024-11-22 00:00:00.0000000 17 0 17 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_reboot[vlab-03] 2024-11-22 00:00:00.0000000 17 0 17 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_count 2024-11-23 00:00:00.0000000 19 0 19 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_order_capability[vlab-03-None] 2024-11-23 00:00:00.0000000 17 2 19 0.8947
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_interface_flap[vlab-03-None] 2024-11-23 00:00:00.0000000 17 0 17 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_keys[vlab-03] 2024-11-23 00:00:00.0000000 19 0 19 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_content[vlab-03] 2024-11-23 00:00:00.0000000 19 0 19 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_flap[vlab-03] 2024-11-23 00:00:00.0000000 19 0 19 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_lldp_restart[vlab-03] 2024-11-23 00:00:00.0000000 19 0 19 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_reboot[vlab-03] 2024-11-23 00:00:00.0000000 19 0 19 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_count 2024-11-24 00:00:00.0000000 10 0 10 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_order_capability[vlab-03-None] 2024-11-24 00:00:00.0000000 10 0 10 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_interface_flap[vlab-03-None] 2024-11-24 00:00:00.0000000 10 0 10 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_keys[vlab-03] 2024-11-24 00:00:00.0000000 10 0 10 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_content[vlab-03] 2024-11-24 00:00:00.0000000 10 0 10 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_flap[vlab-03] 2024-11-24 00:00:00.0000000 10 0 10 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_lldp_restart[vlab-03] 2024-11-24 00:00:00.0000000 10 0 10 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_reboot[vlab-03] 2024-11-24 00:00:00.0000000 10 0 10 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_count 2024-11-25 00:00:00.0000000 55 0 55 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_order_capability[vlab-03-None] 2024-11-25 00:00:00.0000000 55 0 55 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_interface_flap[vlab-03-None] 2024-11-25 00:00:00.0000000 55 0 55 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_keys[vlab-03] 2024-11-25 00:00:00.0000000 55 0 55 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_content[vlab-03] 2024-11-25 00:00:00.0000000 55 0 55 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_flap[vlab-03] 2024-11-25 00:00:00.0000000 55 0 55 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_lldp_restart[vlab-03] 2024-11-25 00:00:00.0000000 55 0 55 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_reboot[vlab-03] 2024-11-25 00:00:00.0000000 55 0 55 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_keys[vlab-03] 2024-11-26 00:00:00.0000000 31 0 31 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_content[vlab-03] 2024-11-26 00:00:00.0000000 31 0 31 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_flap[vlab-03] 2024-11-26 00:00:00.0000000 31 0 31 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_lldp_restart[vlab-03] 2024-11-26 00:00:00.0000000 31 0 31 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_reboot[vlab-03] 2024-11-26 00:00:00.0000000 31 0 31 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_count 2024-11-26 00:00:00.0000000 31 0 31 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_order_capability[vlab-03-None] 2024-11-26 00:00:00.0000000 31 0 31 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_interface_flap[vlab-03-None] 2024-11-26 00:00:00.0000000 31 0 31 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_count 2024-11-27 00:00:00.0000000 20 0 20 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_member_order_capability[vlab-03-None] 2024-11-27 00:00:00.0000000 20 0 20 1
vms-kvm-t1-lag ipfwd/test_nhop_group.py test_nhop_group_interface_flap[vlab-03-None] 2024-11-27 00:00:00.0000000 20 0 20 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_keys[vlab-03] 2024-11-27 00:00:00.0000000 20 0 20 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_content[vlab-03] 2024-11-27 00:00:00.0000000 20 0 20 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_flap[vlab-03] 2024-11-27 00:00:00.0000000 20 0 20 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_lldp_restart[vlab-03] 2024-11-27 00:00:00.0000000 20 0 20 1
vms-kvm-t1-lag lldp/test_lldp_syncd.py test_lldp_entry_table_after_reboot[vlab-03] 2024-11-27 00:00:00.0000000 20 0 20 1

How did you do it?

Move test from onboarding job to t1 job

How did you verify/test it?

Any platform specific information?

Supported testbed topology if it's a new test case?

Documentation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@xwjiang-ms